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(57) Abstract 

A multiple request toggling (MRT) arbitration system for 
prioritizing requests to a set of shared resources (15) by multiple 
requestors (10), especially requests by multiple processors to 
shared resources (15) in a multiprocessor system. The MRT pri- 
ority arbitration system assigns priority to multiple requests on a 
first-come, first-serve basis with the priority of multiple simul- 
taneous requests being resolved through an arbitration network. 
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10 MULTIPLE REQUEST TOGGLING PRIORITY ARBITRATION SYSTEM 

TECHNICAL FIELD 
This invention relates generally to the field of logical priority 
decision mechanisms for use in computer and electronic logic systems. 
15 More particularly, the present invention relates to a method and 
apparatus for prioritizing requests to multiple shared resources by 
multiple requestors, especially requests by multiple processors to common 
shared resources in a multiprocessor system. 

20 BACKGROUND ART 

In an effort to increase the processing speed and flexibility of 
supercomputers, the cluster architecture for highly parallel 
multiprocessors described in the previously filed parent application to the 
present invention entitled CLUSTER ARCHITECTURE FOR A HIGHLY 

25 PARALLEL SCALAR/VECTOR MULTIPROCESSOR SYSTEM, 
PCT/US90/07655, provides an architecture for supercomputers wherein 
multiple of processors and external interfaces can make multiple and 
simultaneous requests to a common set of shared hardware resources, 
such as main memory, global registers or interrupt mechanisms. 

30 One of the important limitations in designing such a cluster 

architecture is providing a fair and efficient method and apparatus for 
prioritizing requests to multiple shared resources by multiple requestors, 
in this case requests by multiple processors to common shared resources in 
a highly parallel multiprocessor system. Prior art methods and systems for 

35 determining the priority among multiple competing requestors to 
common shared resources are inadequate to meet the needs of such a 
cluster architecture. 
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It is recognized that a computer or electronic logic system which 
communicates with a shared resource requires a switching network. This 
implies that conflicts can occur when multiple requestors are attempting 
to simultaneously access die shared resource. Consequently, some type of 

5 arbitration algorithm must be employed to determine which requestor is 
to be granted access to the destination resource having conflicting requests. 
A fair and efficient system must satisfy at least the following goals: (1) any 
free resource will always receive a grant if there is at least one valid 
request attempting to access it; (2) relative time ordering of requests is 

10 maintained (Le., access is granted on a first come first serve basis); (3) equal 
access to all resources is provided for each requestor (i.e., "fairness" is 
ensured when arbitrating among requestors); (4) wait time during 
requestor conflicts is minimized; and (5) arbitration control decision time 
is mmimized. 

15 Although several types of arbitration algorithms exist in the prior 

art, the traditional prior art arbitration algorithms are not effective at 
meeting these goals. Two of the more common prior art arbitration 
algorithms are the Round Robin and the Priority Ring. 

Round Robin is a prior art technique that gives each requestor an 
20 opportunity to be the highest priority. This opportunity is given to each 
requestor, one at a time through a rotating mechanism. The problem 
associated with this is that a requestor's priority is unrelated to when the 
request is actually made. In other words, the requestor might have been 
rotated to lowest priority just prior to the request. Thus, subsequent 
25 requests are serviced prior to the original one. This fails to satisfy goals 2 
and 4 set forth above. 

A Priority Ring is another prior art arbitration technique. This 
scheme gathers requests made over a given time period into a group or 
"ring". At the end of the time period, the ring is closed and all requests 
30 that have been stored in this ring are processed according to a fixed priority 
resolution mechanism. While the requests that were gathered into the 
first ring are processed, subsequent requests are gathered into a new ring. 
When all of the requests in the first ring have been processed, the second 
ring is closed, and the first ring is free to accept new requests. The 
35 problem associated with this technique is that a given requestor always has 
a fixed priority relative to the other requestors within each ring. Thus, 
the algorithm favors certain requests over others and it allows later 



WO 91/20041 



PCT/US91/04061 



3 

requests to be granted before previous ungranted requests, thereby failing 
to satisfy goals 2, 3 and 4 set forth above. 

Because of the inherent limitations of the present methods and 
systems for determining the priority among multiple competing 
5 requestors to common shared resources, it is not possible to fairly and 
efficiently prioritize such requests in a manner that allows for requestors 
to be serviced on a first-come, first-served basis. Therefore, a new method 
and apparatus for a multiple request toggling priority system is needed 
that provides for a fair and efficient prioritization of multiple 
10 simultaneous requests in a single dock cycle. 

ffTTM M AttV OF THE INVENTION 
The present invention provides a method and apparatus for a 
multiple request toggling priority system that allows fair and efficient 

15 arbitration of simultaneous multiple requests to common shared 
resources. The present invention achieves this objective by the symmetry 
and balance of the design of the toggling priority system. All requestors 
are arbitrated in a distributed and democratic fashion. The present 
invention assigns priority to multiple requests on a first-come, first-serve 

20 basis with the priority of multiple simultaneous requests being resolved 
on the basis of a toggling system. 

The Multiple Requestor Toggling (MRT) priority system of the 
present invention is capable of using a simple boolean algorithm to 
control a variety of switching mechanisms. The MRT priority scheme is 

25 applicable to any system where multiple requestors communicate with a 
commonly shared resource requiring an arbitration network to resolve 
simultaneous conflicting requests to that resource. In this case, resolution 
of conflicts refers to the determination of the order in which requests for 
access to the common resource are serviced. The MRT priority system of 

30 the present invention is also useful for determining access to multiple 
shared resources. In this case, part of the MRT priority system, the inhibit 
matrix, is associated with each one of the multiple shared resources and a 
plurality of these inhibit matrices are connected to each of the requestors. 
Each of these inhibit matrices per shared resource are connected to a 

35 common part, the relative priority state storage means, which maintains 
the priority of each requestor relative to the others for all shared resources. 
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The MRT priority system can be used to control a wide range of 
switching applications. The switching mechanism can be embodied in any 
network topology, such as a Ring, an N-cube, a Near Neighbor or a Fully 
Interconnected Crossbar, The MRT algorithm can be employed in any 
5 level of a hierarchical switching network* The switch itself can be 
implemented using any logical steering circuit such as a simple 
multiplexer or other similar mechanisms. 

In the preferred embodiment of the present invention, the MRT 
algorithm is implemented in a synchronous, sequential environment 

10 where the arbitration sampling interval is one system time period (e.g., a 
dock cycle). The MRT algorithm is an effective way of accomplishing the 
goals for an arbitration algorithm as set forth above. In the preferred 
embodiment, the present invention is implemented with relatively 
simple circuitry and in practice is an extremely efficient solution for 

15 determining which requestors) will receive a grant during any sampling 
interval. In addition, the MRT algorithm optionally provides the 
capability of producing a grant per resource per time period when used in 
multiple requestor/multiple resource applications. The grants per 
requestor can also be encoded to form multiplexer select inputs used to 

20 steer a data switch mechanism implemented using multiplexers. 

Although the present invention may be used in many situations 
where arbitration among multiple requestors is necessary, the present 
invention is a particularly important ingredient in the design of highly 
parallel computer processing systems. In the preferred embodiment of the 

25 highly parallel computer processing system utilizing the present 
invention, each multiprocessor cluster includes shared resources for 
storing and retrieving data and control information, a plurality of tightly- 
coupled, high-speed processors capable of both vector and scalar parallel 
processing and a plurality of distributed external interfaces that allow for 

30 the transfer of data and control information between the shared resources 
and one or more external data sources. All of the processors and external 
interfaces in the cluster are symmetrically interfaced to the shared 
resources, both intra-cluster and inter-cluster, through a plurality of 
arbitration nodes that utilize the MRT priority system of the present 

35 invention. At least two processors and two external interface means are 
connected to each arbitration node. For inter-duster access, a remote 
cluster adapter associated with each cluster and also having the MRT 
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priority system of the present invention is operably connected to remote 
duster adapters in all other dusters. The remote duster adapter allows the 
arbitration nodes in one duster to access the shared resources of all other 
dusters, and also allows all other dusters to access the shared resources 

5 within this duster. 

The shared resources of the preferred embodiment indude a shared 
main memory, a shared group of global registers and a shared interrupt 
mechanism. Access to the shared resources is equivalent and symmetric 
across all processors and external interfaces. This is true even if the 

10 processors and external interfaces are connected to the same arbitration 
node, to different arbitration nodes in the same duster, or to arbitration 
nodes in different dusters. The need for job optimization which would 
otherwise be required in order to accommodate a particular 
memory-hierarchy is minimized by the symmetry of access to shared 

15 resources accomplished by use of the MRT priority system of the present 
invention. 

An objective of the present invention is to provide a method and 
apparatus for a multiple request toggling priority system that allows for a 
fair and effident prioritization of multiple simultaneous requests in a 
20 single dock cyde. 

Another objective of the present invention is to provide a method 
and apparatus for a multiple request toggling system algorithm that grants 
any access that can be granted to the requestor. 

A further objective of the present invention is to provide a method 
25 and apparatus for a multiple request toggling priority system algorithm 
that maintains the relative time ordering of the requests. 

An additional objective of the present invention is to provide a 
method and apparatus for a multiple request toggling priority system 
algorithm that provides equal access to all requestors. 
30 Still another objective of the present invention is to provide a 

method and apparatus for a multiple request toggling system algorithm 
that minimizes the wait time during conflicts for requestors. 

Still another objective of the present invention is to provide a 
method and apparatus for a multiple request toggling priority system 
35 algorithm that minimizes the control dedsion time for requestors. 
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These and other objectives of the present invention will become 
apparent with reference to the drawings, the detailed description of the 
preferred embodiment and the appended claims* 

5 DESCRIPTION QFTHE DRAWINGS 

Fig. 1 is a block diagram of an arbitration network showing an MRT 
arbitration algorithm. 

Figs. 2a and 2b are a detailed circuit diagram for the MRT inhibit 
matrix shown in Fig. 1. 
10 Figs. 3a and 3b are more detailed circuit diagrams of the MRT 

relative priority state update logic and the relative priority state storage 
means shown in Figs. 1 and 2. 

Fig. 4 is a state diagram representation of a relative priority state 
storage means for a four requestor MRT system of the present invention. 
15 Figs. 5a, 5b, 5c,and 5d are state diagram tables for the four requestor 

MRT system shown in Fig. 4, 

PESCRimQN QFTIffifR^Hfi^P EMPOPIMENTS 
Referring now to Fig. 1, the method and mechanism of the MRT 

20 arbitration algorithm will be described. In the preferred embodiment, the 
MRT arbitration system comprises a plurality of request queues 10, relative 
priority state update logic 11, a relative priority state storage means 12, and 
one or more inhibit matrices 13. 

The input to the MRT arbitration system is a set of request queues 

25 10, one per requestor* The input request queues 10 store the incoming 
requests including any information necessary to make the arbitration 
decision, such as the address of the destination resource which is useful in 
identifying the resource being requested, as well as checking to see if any 
reserved resources are busy. In the preferred embodiment of the 

30 invention, each request queue 10 operates as a First-In-First-Out (FIFO) 
queue structure. A request queue 10 is loaded when a requestor has an 
operation ready for arbitration, and it is unloaded when the MRT 
algorithm generates a grant 14 for that requestor. The outputs of the 
request queue 10 are used to drive both the relative priority state update 

35 logic 11 and the inhibit matrix 13. 

The MRT algorithm maintains a relative priority state storage 
means 12 which stores the relative priority state of every requestor relative 
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to every other requestor. Each cell or bit in the relative priority state 
storage means 12 represents the relative priority of two requestors. This 
cell indicates which of the requestors will be granted access in the case of 
simultaneous resource requests. Each of the cells of the relative priority 
5 state storage means 12 are connected to the inhibit matrix 13. 

When the MRT algorithm is used to control access to a single 
resource, each cell in the relative priority state storage means 12 drives two 
gates in the inhibit matrix 13 for mat destination. One gate represents 
requestor x inhibiting requestor y if x is higher priority, while the other 

10 gate represents requestor y inhibiting requestor x if y is highest. 

When the MRT algorithm is used in a multiple destination resource 
application, one relative priority state storage means 12 can be connected 
by means of fanout logic 17 to drive all inhibit matrices 13 (one per 
destination). In this case, the relative priority state update logic 11 is 

15 sufficient to ensure "statistical fairness" for all requestors (although more 
than one relative priority state storage means 12 could be used). 
Furthermore, for N requestors, the relative priority state storage means 12 
can be thought of as an N by N triangular matrix, minus the diagonal 
(there is no relative priority between a requestor and itself). For a given 

20 number of N requestors, the number of cells required in the relative 
priority state storage means 12 is 0>J*(N-l))/2. 

Referring now to Fig. 2, the inhibit matrix 13 will be described. The 
inhibit matrix 13 is a combinational logic network. There is one matrix 
per resource. It accepts inputs from the request queues 10 and the relative 

25 priority state storage means 12. First, the inhibit matrix 13 examines the 
outputs of the request queues 10, searching for a request mat decodes to the 
resource for which this matrix is arbitrating. Once a valid request is 
established from a specific requestor for this resource (and any reserved 
resource check for this destination indicates that the resource is available) 

30 an arbitration enable condition exists for this requestor. 

It will be recognized that a distinction may exist between a resource 
being arbitrated for and a reserved resource. A given resource being 
arbitrated for may have one or more reserved resources associated with it. 
The MRT arbitration system may, optionally, include a qualification step 

35 that checks the arbitration request to see if it is attempting to access a 
reserved resource. The result of this qualification can be used to validate 
the operation being presented to the MRT arbitration system. Thus, 
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reserved resources can have a busy time associated with them that 
prevents new requests from overrunning previously granted requests. 
When a reserved resource is busy, that reserved resource will not prevent 
requests for other resources from being granted. In this sense, the MRT 
5 arbitration system can be used to multiplex multiple resources that are 
only accessible through a single destination path. For example, in the 
event that each of a number of resources associated with a destination 
path has a queue for holding arbitrated requests and the queue for one of 
the resources becomes full, the reserved resource qualification step 

10 prevents additional requests from overrunning the one queue, while still 
allowing other requests to be routed to other open queues associated with 
the single destination path. This amounts to a pre-processing check on the 
ultimate availability of one of a plurality of resources associated with a 
single destination path prior to the time that the request is actually 

15 arbitrated. As a result, the pipelines or queues involved in the arbitration 
can be continually filled and a bubble in the pipeline is not created by 
arbitrating for a request that cannot be serviced, for example, because of a 
full queue. 

For N requestors the inhibit matrix 13 is organized as a full N x N 
20 matrix. The arbitration enables for each requestor form the rows of the 
matrix, while the columns represent an inhibit condition for each 
requestor. The inhibit matrix 13 has the property that a requestor of 
higher priority disables a requestor of lower priority. Therefore, the 
requestor with the highest priority is the only one enabled to receive a 
25 grant 14 (per column). Each row /column intersection in the inhibit 
matrix 13 corresponds to a specific requestor inhibiting another requestor 
from obtaining a grant 14. The logic at each intersection point interrogates 
the relative priority state bit corresponding to the appropriate pair of 
requestors. 

30 Grants 14 for each requestor are generated by logic that detects no 

inhibits in a column. If the requestor in a given row has an arbitration 
enable condition and is currently higher priority than another requestor in 
a given column, an "inhibit" will occur such that the logic constituting 
this column will not generate a grant 14 for the latter requestor during this 

35 sampling interval. Because the value of the relativ priority state storage 
means completely describes the priority hierarchy at all times, the highest 
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priority requestor with a valid arbitration enable will be the only one able 
to obtain a grant per inhibit matrix 13 (i.e., per resource) each interval 

Referring now to Figs. 3a and 3b, the relative priority state update 
logic 11 and the relative priority state cell 18 will be discussed. The relative 

5 priority state update logic 11 exists at the input to the relative priority state 
storage means 12. It accepts as input, requests from the request queues 10 
and grants 14 out of the inhibit matrix 13. The relative priority state 
update logic 11 is entirely combinational and its function is to determine 
when to modify or update the bits in the relative priority state storage 

10 means 12. The purpose of the relative priority state update logic 11 is to 
modify the relative priority cells associated with a given requestor, such 
that the requestor becomes lowest priority. This action is performed so 
that any previous request dynamically rises in priority relative to the new 
one. Each cell in the relative priority state storage means 12 consists of a 

15 set/reset circuit which stores the relative priority between two requestors. 
There are two inputs to each cell 18. One input sets requestor x to lowest 
priority, and the other sets requestor y to lowest priority. If both inputs are 
true, the state of the cell toggles. If neither input is true, the cell remains 
unchanged. When it is necessary for the algorithm to set a requestor to 

20 lowest priority, the inputs of all cells corresponding to that requestor are 
enabled. These are the cells which define the priority of that requestor 
relative to each of the others. When two requestors both need to be set to 
lowest priority, the relative priority state update logic 11 toggles the 
relative priority cell 18 for that pair of requestors. This results in one 

25 requestor being higher priority than the other, but no bias exists towards 
favoring one priority state over the other. This toggling function is the 
mechanism which implements the "fairness" feature of the MRT 
algorithm. 

Because one of the goals of an arbitration system is to iruiumize the 
30 control decision time, the preferred embodiment of the MRT algorithm 
uses an "anticipatory" update function to maintain the relative priority 
state. In other words, the relative priority state has already been "updated" 
at the time a request arrives. This is accomplished by allowing the update 
to occur even when the request queue is empty. In essence, the update 
35 function is always occurring while the request queues are empty, such that 
all inactive requestors are continuously attempting to set themselves to 
lowest priority, thereby toggling their appropriate relative priority bits. An 
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update to the state storage means 12 is generated whenever an access is 
granted 14 or whenever the associated request queue 10 is empty. When 
the relative priority state update logic 11 detects a valid request at the 
output of a request queue 10 (thus the queue is not empty), the state 
5 update logic 10 stops updating state matrix 12, allowing the relative 
priority of the requestor to dynamically rise until a grant 14 is given. 
Thus, in its simplest form, the update function is a logical M OR H of request 
queue empty or grant (see Fig. 3a). This is an important feature for time 
critical applications of the MRT algorithm of the present invention* 

10 One characteristic of the MRT algorithm is that the priority state is 

modified based on when requests appear. Because the priority state reflects 
the relative age of the requests, giving older requests higher priority than 
newer requests, the priority state dictates the order in which the requests 
are granted. Thus, the MRT algorithm maintains relative time ordering 

15 of the requests as seen at the outputs of the request queues 10. This 
characteristic effectively minimizes the wait time when conflicts exist 
because newer requests cannot be granted before older requests. The 
longest a request ever has to wait is strictly a function of how many 
ungranted requests have been presented prior to this one. 

20 Another characteristic of the present invention is that internal 

feedback is used (in the form of a grant per requestor 14) to modify the 
relative priority state 12 and unload the request queues 10. The grant 14 
sets the requestor to lowest priority in anticipation of a new request and 
advances the request queue 10 to the next item. The queue may or may 

25 not contain another request. If a request is present, it will be arbitrated 
against other requests as the lowest priority. As long as any pending 
requests are accessing different resources and their associated reserved 
resources are not busy, all requests can be granted. Thus, the MRT 
arbitration system has the ability to generate grants 14 for die same (or 

30 different) requestor(s) every cycle. This accomplishes the goal of granting 
any access that can be granted. 

When the MRT algorithm is used in a multiple resource 
application, the set of requestors competing for one of the resources is a 
subset of all the requestors that are ordered in the relative priority matrix. 
35 Therefore, this subset is also ordered in relative priority. Because the 
relative priority state 12 reflects the relative age of the requests, the priority 
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state has no bias towards favoring any particular priority assignment, and 
fairness is ensured within the subset 

The MRT arbitration system, when used with multiple inhibit 
matrices 13 (for multiple resources) internally generates a grant per 
5 requestor for each inhibit matrix 13. Thus, the algorithm maintains a 
grant per requestor, per resource 15. Since these grants are generated in 
both forms by the algorithm, they can be combined in either dimension to 
not only generate grants per requestor 14, but grants per destination 15. 
This can be extremely useful in certain applications such as initiating 

10 references to banks of memory. 

Referring again to Fig. 1, an optional output encoder 19 can be 
included in the MRT arbitration system which takes the grants per 
requestor and encodes them for each resource. This is very useful when 
controlling a switch mechanism implemented using multiplexers (per 

15 destination resource) which select each of the requestors. Because the 
MRT system only grants one requestor per destination 15 each cycle, the 
algorithm guarantees that the grants per requestor 14 are mutually 
exclusive. This allows the output encoder 19 to be implemented as a 
simple encoder function, as opposed to a priority encoder which is more 

20 complex. 

Referring now to Fig. 4, an example of a four requestor MRT system 
of the preferred embodiment will be described. It can be seen that in order 
to maintain the relative priority among four requestors of equal priority, it 
is necessary to store information on six conditions or states that identify 

25 the relative priority of each of the six possible combinations of priority 
pairs, e.g., Req 0*s priority with respect to Req 1, Req O's priority with 
respect to Req 2, etc. m the MRT system of the present invention, the state 
of each priority pair is stored as a single bit that represents the requestor's 
relative priority with respect to one specific other requestor. Because a 

30 requestor is either higher or lower priority than any other requestor, one 
state (one cell) is sufficient to represent each priority pair. Thus, for N 
requestors, it is possible to represent the number of relative priority states 
among all N requestors with (N*(N-l))/2 bits. 

Figs. 5a - 5d show a relative state table for all of the priority pairs of 

35 the 4 requestor system shown in Fig. 4. In this system, each priority pair is 
represented by a single cell. The inputs to the relative state table are 
comprised of both a positive and negative representation of each 
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requestor* When the update condition is true for a given requestor, the 
algorithm attempts to set all of the bits for that requestor to lowest priority, 
Le., positive bits are set to "0" and negative bits are set to "1". To M read M 
the relative state table as shown in Fig- 5a, each row is examined. In the 
5 initial state shown in Fig. 5a, row 0 shows Req 0 is lower than Req 1, Req 2 
and Req 3. Row 1 shows that Req 1 is lower than Req 2 and Req 3- Row 2 
shows that Req 2 is lower than Req 3. Thus, the priority pairs for all six 
states are represented in the relative state table 

Referring now to Fig. 5b, the relative state table is shown at Time 1 
10 when Req 2 has an update condition. As can be seen, Req 2 modifies the 
relative state table in response to the update and is now the lowest priority 
requestor. Req 2 has set all of its positive states to n 0" and all of its 
negative states to "1". Reading row 0, Req 2 is lower than Req 0, but Req 0 
is still lower than Req 3 and Req 1. Row 1 shows that Req 2 is lower than 
15 Req 1, but Req 1 is still lower than Req 3. Finally, row 2 shows that Req 2 is 
still lower than Req 3. Thus, Req 2 is set to the lowest priority and will be 
serviced if Req 0, Req 1 or Req 3 is not presently requesting access to the 
resource being arbitrated. 

The relative state table is shown at Time 2 in Fig. 5c when new 
20 update conditions are active for both Req 1 and Req 3. Again, an attempt is 
made to set all of the cells associated with each requestor that has a valid 
update condition to the lowest priority. In row 0, both Req 1 and Req 3 are 
now lower than Req 0. Req 2 is still lower than Req 0 because the priority 
pair bit (0/2') remains in its previous condition, if no update condition 
25 exists for Req 0. The circled priority pair bit (1/30 illustrates the toggling 
case when two requestors collide (i.e., have simultaneous update 
conditions), In this case, Req 1 is higher than Req 3 and would be the 
requestor to be serviced first in the event that they are both contending for 
the same resource. 

30 Fig. 5d shows the relative state matrix at Time 3. During Time 3, a 

new update condition exists from Req 0 which updates all of its priority 
pair bits. After all requestors have been serviced, and assuming that all 
input request queues are empty, the relative state matrix begins to toggle 
the priority state bits on each dock cycle until one or the other requestors 

35 "freezes' 1 the state with a new valid request This toggling insures that if 
simultaneous requests from any two requestors are received again, both 
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requestors have an equal chance of being set to the higher priority in the 
priority pair bit of the relative state matrix. 

It will be noted that in the MRT system shown in Figs. 5a-5d, a 
maximum delay of four cycles can occur if all four requestors have valid 
5 requests to the same resource during the same cycle (assuming no 
reserved resource busy time). 

In summary, the MRT algorithm meets all of the specified goals 
listed above. It is superior to prior art techniques in performance. It is 
easily implementable in simple circuitry. It provides the ability to 
10 generate the grant result in several forms, and is adaptable to a wide range 
of switching arbitration control applications. 

Although the description of the preferred embodiment has been 
presented, it is contemplated that various changes could be made without 
deviating from the spirit of the present invention. Accordingly, it is 
15 intended that the scope of the present invention be dictated by the 
appended claims rather than by the description of the preferred 
embodiment. 

We claim: 
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CLAIMS 

1. A multiple request arbitration system for determining priority 
among a number N of requestors to one or more shared resources, the 
arbitration system comprising: 

5 state storage means for representing a plurality of relative 

priority state indicators, each priority state indicator representing 
the priority between a unique pair of requestors; and 
for each requestor: 

input means operably connected to the state storage 
10 means for presenting a request from the requestor to the state 

storage means; and 

output means responsive to the state storage means for 
signaling the requestor and a selected shared resource that the 
requestor has obtained grant to the selected resource in 
15 response to the request and operably connected to the input 

means for receiving the request, 

such that the relative priority of each unique pair of 
requestors is determined by the state storage means. 

2. The multiple request arbitration system of claim 1 wherein the 
20 number of relative priority state indicators is at least (N*(N-l))/2. 

3. The multiple request arbitration system of claim 1 wherein the state 
storage means determines the relative priority on a first-come, first-serve 
toggling basis. 

4. The multiple request arbitration system of claim 1 further 
25 comprising qualification means operably connected to the input means 

and the outputmeans for determining whether the request is a valid 
request based on whether the selected resource is available. 

5. A method for determining priority among a number N of 
requestors to a shared resource in a logic system, the method comprising 

30 the steps of: 

providing a relative priority memory array for storing the 
relative priority of each unique pair of requestors as a single bit in 
the relative priority memory array; 

for each dock cycle in the logic system: 
35 updating the relative priority memory array in 

response to a new request from one or more of the 
requestors; 
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determining which of the requests has the highest 
priority as indicated by the relative priority memory array; 
and 

granting access from the requestor to the shared 
5 resource to the request having the highest priority. 

6. The method of claim 5 wherein the step of updating the relative 
memory array includes: 

for each requestor, setting the single bits in the relative 
priority memory array for the requestor to a lowest priority unless 
10 the requestor has a new request; 

in the event that both requestors associated with a single bit 
in the relative memory array are attempting to set that bit to the 
lowest priority, toggling the bit between lowest priority for each of 
the requestors on successive dock cycles. 
15 7. The method of claim 5 further including the step of: 

providing a queue for each of the requestors to hold multiple 
requests from the requestor to the shared resource such that the 
new request will be the request at the head of the queue. 
8. A multiple request toggling arbitration system for determining 
20 priority among a number N of requestors to a number M of shared 
resources, the arbitration system comprising: 

N request queue means, each request queue means for 
temporarily storing one or more requests from an associated 
requestor; 

25 relative priority state storage means for storing the relative 

priority of each unique pair of requestors as a single bit in the 
relative priority state storage means representing a relative priority 
state of the requests for that unique pair of requestors; 

update priority logic means operably connected to each of the 

30 N request queue means and to the relative priority state storage 

means for receiving the next request to be processed for each 
requestor and for updating the status of each unique pair of 
requestors on each clock cycle of the arbitration system in 
accordance with a toggling priority scheme; 

35 M inhibit matrix means, each inhibit matrix means for 

determining in response to the relative priority states of the 
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requests which request will be granted access to the shared resource 
associated with the inhibit matrix means; 

fanout means operably connected to the relative priority state 
storage means and to each of the inhibit matrix means for 
5 distributing the relative priority states to each of the inhibit matrix 

means; and 

N destination resource decoder means, each destination 
resource decoder means operably connected to an associated request 
queue means and to each of the M inhibit matrix means for 
10 determining which of the M shared resources is indicated by the 

request and for enabling the inhibit matrix means associated with 
the shared resource indicated by the request 

9. The arbitration system of claim 8 further comprising: 

N feedback means, each feed back means operably connected 
15 to each inhibit matrix means and to the update priority logic means 

for setting the priority of a requestor to lowest priority after a request 
for die requestor has been granted by the inhibit matrix means. 

10. The arbitration system of claim 9 further including output encoded 
means operably connected to each of the inhibit matrix means for 

20 receiving grant signals indicating that a request has been granted between 
a given requestor and shared resource and for encoding the granted 
request for distribution to the shared resource. 

11. The arbitration system of claim 8 further including destination 
grant means operably connected to each of the inhibit matrix means for 

25 receiving grant signals indicating that a request has been granted between 
a given requestor and shared resource and for distributing the grant signal 
back to the given requestor. 
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